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Dis pIa>L,aia:a a pfimen t and m sshod 
Technical field 

The present invention relates lo a tracking device and a method for a sensory 
feedback from a cursor status for a cursor with graphical details being scanned or passed in 
connection with a program or comprising it. More specifically the invention provides a signal 
to be generated for a sensory feedback generating a movement of the irucking device. 

State of the art 

The user interface in form of a window (Window'') as a facility lo access special 
program functions in a data prognm is found in almost every modem interface. The program 
basing on the use of windows comprises also function keys in e.g. key rows, screen and 
display delimiters and icons, so-called graphic symbols. 

To achieve access to the functions contained in the symbols a cursor is controlled by 
means of a tracking device ( computer mouse, trackball, pointer, etc.) over a display unit 
showing the symbols, the fimction of the symbol being produced by e.g. pressing a key with 
one or several touches, 

A problem with the control of the cursor to effect the symbols arises when it is 
difficult to fix the cursor to the symbol in a distinct way to let the touches have the desired 
effect. 

It is easier to hit e.g. keys simated at the edge of a display than one in its centre. To 
hit a key at the edge the computer mouse is pulled quickly in the right direction to reach the 
key. It has no importance if the computer mouse is pulled loo far. The cursor will anyhow 
stop at the edge. To hit a key simated e.g. in the centre of the display frame more 
coordination is however required by a user of the computer mouse to hit the tsirget, thus, the 
user must e.g. slow down the u-acking device before the key is reached to let the cursor land 
on tlie key. This step takes time and might be difficult and might even give iche user stress 
and irritation. 

A further problem, which is relaxed lo the use of tracking devices for said object, 
is that the user requires a simultaneous feamre, i.e, to e.g. quickly localize ihe key for the 
memorizing function in a program without necessarily having to let the eye scan the display 
unit. 

In the european parent application EP-Al -0,607,580 a computer mouse with a pm 
is described receiving signals from a host computer unit effecting the pin which generates 
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sensory signals ro a users finger top e.g. when ihe cursor stacus is altered. 
The invention according to said EP-appiicaiion is, however, nor without problems m that a 
finger cop must be kept in contact with the pin. Ergonomciric studies have shown that the 
user of a computer mouse when continuously using the computer mouse hardly can Jceep the 
finger tops over the same spot over a longer period of lime. This is easily understood by 
ordinary people as some users are easily seized with cramp, writing cramps being a well 
known complaint. Furthermore, some people suffer from a lighter or heavier trembling- Thus 
the computer mouse with a pin is restricted in its use for a not negligible pan of the users 
of tracking devices. 

Summary of the invention 

The present invention intends to solve above mentioned problems z^aied to a window 
interface and sinular in a new and Innovative manner. 

To achieve said object of the invention it is for marking graphical details in 
connection with or comprised in the program proposed a tracking device as a user interface 
for the access of program functions comprised in the details. 

A cursor as a tracking device controlling on a display receives a sensory feedback 
from status signals for a user of the cursor in a host unit, when the cursor hits or passes said 
graphical details, in such a way that means arranged in the tracking device generate a 
movement of the tracking device. 

The movement of the tracking device consists of that it vibrates, bom^oes. bumps or 

slants. 

The cursor might be fixed within the limits of optional details, even three- 
dimensional ones, when the cursor hits the limit or passes it and the cursor is thus released 
by pushing the tracking device mantle downwards. 

A graphical detail might be an icon, a key, a window or a border limiting the 

window. 

Alternatively, graphical details in form of key rows provide various sensory feedback 
depending on the key and its function. 

In a further alternative the cursor being fixed within a detail, is free to move wiiiun the 
borders of the detail. 

The cursor, being fixed within a three-dimensional object or detail, is possibly free 
to move within the volume of the object or the detail in an embodiment w]ih the cursor 
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possibly generaiiiig a shadow within the object or the derail when drawn our of these without 
first having been released. The shadow allows that the cursor can be moved more easily into 
the object or the detail. The invention comprises even a method for marking graphical details 
by means of a tracking device, 
5 Brief description of the drawing 

The invention will be described here below more in deiail wiih reference to the 
attached figures of the drawings, where 

Figure 1 schematically illustrates a tracking device in form of a compuier mouse 
connected to a host computer unit with a display showing graphical details and a sensory 
10 feedback to the computer mouse according to the invention, 

figure 2 schematically illustrates an alternative sensory feedback in a tracking device 
according to figure 1, 

Figure 3 schematically illustrates a pressing of the tracking device according to 
figm^ 1 in an embodim«at of rhe invention, 
15 Figure 4 schematically illustrates in an exploded view of the compuier mouse an em- 

bodiment of how a means might be arranged in the computer mouse to achieve a movement 
of the computer mouse. 

Figure 5 schematically illustrates how a cursor with a shadow is shown, when the 
user of the cursor touches a tracking device in a three-dimensional envirocmenc according to 
20 an embodiment of the invention. 

Detailed description of preferred embodiments 
The present invention is here described more in detail with alternative embodiments 
illustrating the technology of the invention and the cognitive, tactile and motoric advantages 
provided by a tracking device according to the invention. 
25 Figure I illustraies schematically a compuier mouse 10 connected to a host unit 12 

in form of a computer, here a PC, with a display unit 14 and a key board 16. 

The present invention with its embodiments specifically describes a compuier mouse 
10, the invention is however generally applicable lo a majority of already known tracking 
devices such as crack balls for portable computers, pointers, etc. 
30 The computer mouse 10 consists of a casing 20 movable in relation to a bottom 

ponion 18 and the conventional function keys 22, 24. Furthermore > the computer mouse is 
cotmected to a host unit 12, 14, 16 by means of a signal cable 26 comprising signal lines for 
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a track balls, here nor shown, cransmitcers in the x and y-direction, Funhermore, ihe signal 
cable comprises lines for oansmiiting siams signals for ihe cursor 28 from a cursor controller 
comprised in rhe host unit 12, 14, 

The display 14 shows schemaucally in its frame 30 how the interface might be in a 
window environment. The frame 30 besides the display cursor 28 a window 32, an icon 34, 
a display border 36, a line of three keys 40, 42, 44 and three areas with special attributes not 
to be described in detail. 

When the cursor 28 by means of the computer mouse 10 is moved towards or over 
the periphery 32, 34, 36, 40, 42, 44 of a graphical detail the host unit 12, 14 in one 
embodiment of the invention generates by means of the cursor controllers stams (x- and y- 
coordiraies, stams flags, etc.) for the cursor 28 a sensory feedback in form of a signal by 
meaiis of signal lines in the cable 26. The signal provides thai a nneans axiranged in the 
computer mouse 10 generates a movement of the computer mouse 10, e.g. in a form thai the 
computer mouse vibrates, bounces, bumps, slants, etc. 

In an alternative embodiment even the cursor 28 is fixed within the borders » bur 
preferably in such a way, thai it is free to move between the borders, e.g, between the 
borders 32 and 34 for the window and the icon, respectively, if it is fixed withiut the window. 

In fixing the cursor 28 within a graphical detail the stams register for the cursor 28 
is initiated that a signal is sent to the computer mouse 10 with its casing 20 receiving a 
sensory feedback in that the cursor 28 has been fixed within or to a graphical detail 32. 34, 
36, 40, 42, 44. In itit present embodiment the casing 20 vibrates 45 in relation co the bouora 
ponion 18. The complete computer mouse might evenmally vibrate in an embodiment without 
any specific casing and specific bottom portion. A tracking device 10 migiit instead of 
vibraiing boixnce or bump each time ihc cursor is moved towards or fixed onto a graphical 
detaiL 

The vibntions can be achieved fay means of devices such as electromagnets, 
piezoelectric transmitters, composite metals and other devices available in the market possibly 
achieving vibrations. 

Furthermore, the graphical detail, in which the cursor 28 has been fixed, might in 
another embodiment be identified by means of the vibration frequency. In mots cases it is 
quite sufficient that a few graphical details are to be identified by means of iihe vibration 
frequency, e.g. by means of an enter key, here designates 40, so that a simultaneous effect 
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is achieved in thai e.g. a program or a dara Hie has to De eniexed. This is achieved 
wijiiom Che user necessarily sweeping or drifting with his eyes over the frame 30 lo find die 
enter key 40. In principle mosi graphical derails might, however, be provided with a specific 
code by means of the vibration frequency. 

The cursor 28 being fixed within a frame it must be possibly released from this 
fixation. According to an embodiment of the present invention this is achieved in that die 
computer mouse 10 or any other used tracking device is exened to a pressure downwards 
effecting a signal transmiuer, e.g, a pressure transmitter, to change the starus of the cursor 
28, the user then feeling as if it presses oui the cursor or is diving under the edge of die 
border, thus improving the perception of the process on the frame 30. 
In feeling that the cursor is sliding over e.g. a key 40 the picmre of the key 40 is elucidated. 
In a similar way the picmre of a window 32 is intensified. 

A parallel to ihe present invention is the introduction of shadows in graphical 
interfaces. In that the user can see die shadow of an interface, such as a windov/, it becomes 
much easier to understand die concept with several layers in windows, i.e. windows 
overlapping each odier. This provides a three-dimensional effect and improves ihe aesiethic 
aspect and provides even an improvement of the users perception of the interface rending it 
uxor effective. The present invention achieves similar features which provides the parallelism. 

In figure 2 is shown another embodiment of a sensory feedback according to the 
invention. 

Figure 2 schematically illustrates the computer mouse 10, the casing 20 being 
movable in relauon to the bottom ponion 18, slants to the right in the figure, marked by a 
downwards pointing arrow as a sensoty feedback from the status register of the cursor 28. 
The slanting might ^ven be achieved forwards, backwards, to the left, etc. Thus, the 
corresponding slanting indicates a code. The slanting to the right might e.g. imply the key 
for the emering function 40. In the same way, the other slanting positions might indicate the 
code for another graphical detail 32, 34, 36, 40, 42, 44. Funhermore, altemaiing slanting 
positions for a feedback might indicate further codes. 

Meanss for slanting the computer mouse 10 might consist of electromagnets, relays, 

etc. 

To leave a fixation within the limited area of a graphical detail or its periphery it is 
illustrated in figure 3. how the casing of The computer mouse 10 is pressed against the 
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bottom portion 18. a pressure iransmiiier e.g. generating a signal to ihe cursor 28 lo leave 
a limiced area, where ii previously had been fixed. As already mentioned the computer mouse 
10, with che casing 20 and the bottom ponzon forming together a unit, ever; by means of a 
convenient aixaneement is provided with a pressure cransnjiticr to achieve signals releasing 
5 the cursor 28- 

Reganiing the arrangement of meanss adapted to generate the sensor^' feedback in 
a tracking device it is preferably design precautions for ihe man of ±e an, buc whh reference 
to figure 4 an embodiment is exemplified how the means might be arranged wichin a 
computer mouse 10. 

10 Figure 4 illusiraies, how an electromagnet 50 by means of screws hi arranged in a 

means of attachment 52. here fixed by means of screws in the boaom portion 18 of the 
computer mouse 10, Between the casing 20 and the bottom portion 18 a resiJient means 56 
is placed. When the computer mouse 10 receives the sensory feedback signal the anchor 58 
of the electromagnet 50 hits the casing 20 generating a movement in the casing 20. The 

15 movement transforms imo a vibration by means of the potential energy stored in the resilient 
means 56. To achieve a coding of the sensory feedback as described above already known 
meanss generating pulse sequences might be used. 

Moreover, the present invention solves the problems connected co the sensory 
feedback by means of a pin as described in EP-A 1-0-607, 580 in diat the mouse iiself vibrates 

20 making it easier for the user with a tendency to be seized with cramp and trembling to use 
the computer mouse 10. They do not necessarily have to touch the computer mouse with any 
specific position of the hand as the whole computer mouse according to che invention is 
moving. 

Figure 5 illustrates how a cursor with a shadow is shown, when according co one 
25 embodiment of the present invention a user of the cursor couches a tracking device in a 
three-dimensional virtual surrounding 60, e.g, a space. 

The tracking device 10 is moved to a desired vimial object 62 in form of a ihree- 
dimensional volume without the objeci being visible in space. However, che cursor 28 
controlled by the pointer might be followed on a display means dclimiced by means of che 
30 solid line 64. The display means is not necessarily a computer screen 30 but may consist of 
any ozher form of picmre reproduction means, e.g. a mirror. 

The objecr 61 is visible lo a user on che display means delrmued by the line 64 in 
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figure 5. i.e. not virrualjy as ihe surroundings 60. 

Moreover, ihe cursor 28 has a shadow 66 on ihe display means 64 reMtiaining wiihin 
the objeci. when ihe cursor is pulled out of ihe object, if the tracking device is not released 
by means of e.g. a pressing downwards, A user of the n-acking device finds in some way 
5 easier back to the object 62 in the virtual surroundings after e,g. a pause or another exit from 
the space of the object 62. The cursor is ihen integraied with the shadow when it is situated 
in the object 62. 

The facts mentioned above are e.g. applicable in CAD programs such as ALIAS* i,a. 
being used in the car industry lo design products, where it is a problem to decide, where in 
10 the space depth the cursor 28 is situated. It should also be observed that the virmal space 60 
may comprise numbers of space objects 62 in various geometric forms, the usefulness of the 
shadow 66 becoming obvious. 

The depth of a space object 62 is e.g. defined by means of a coordinate system 68 
in three dimensions, such as a canesian or a polar system, etc. 
15 Another possible application area for the embodiment above of the cursor 2S with 

a shadow 66 is in surgery field, e.g. for training of surgical candidates or for more advanced 
surgery of more or less complicated operations. 

A three-dimensional picture or a picture in perspective consists conventionally of 
a program providing mesh models of objects 62 without any space therein. Thte space might 
20 be calculated in real time when a surface is passed in the object 62. Thus, a surface in the 
object 62 is defmed by means of here not shown polygons rendered in real time, the 
necessary surface to obtain space thus being obtained. 

The present invention has been described with preferred embodiments not to be 
considered to limit the invention. It is the definition of the claims that defines the invention 
25 for the man of art. 
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1. A irackiog device for marking graphical details (32, 34, 36. 40, 42, 44) in 
connection with or comprised in a program as an interface for the access of program 
functions comprised in the details, characteri2ed in than a cursor (28) comrolled by means 
5 of the tracking device' (iO) on a display receives a sensory feedback from stams signals for 
a cursor comrol in a host miit (12. 14. 30), when the cursor hits or passes said graphical 
details (32, 34, 36, 40, 42, 44) m such a form that means (50) provided in the cracking 
device HO) generate a movement (46) of the tracking device (10), where a cursor (28) being 
fixed in a detail can freely move within the borders of the detail (32, 34, 36, 40, 42, 44). 
10 2. A tracking device according to claim 1, eharacteiized i^ that the movement of 

the tracking device consists of chat it vibrates, bounces, bumps or slams. 

3. A cracking device according to claim I to 2, characterized in thai ihe cursor can 
be fixed within the borders of opiional details (32, 34, 36, 40, 42, 44), when ri:e cursor (28) 
hits the borders or passes them and when the cursor is released during a pressing-down of 

15 the casing (20) of the tracking device. 

4. A tracking device according to claim 1 to 3, ch3ractgri2ed in that a graphical 
detail can consist of an icon (34), a key (40, 42, 44), a window (32) or an edge (36) 
delimiting the frame (30), 

5. A tracking device according 10 claim 1 to 4, characterized in that graphical 
details in fonn of key rows are rendering different sensory feedbacks depending on the key 
and its function. 

6. A tracking device according to claim I to 5, characterized in that Hie cursor (28) 
being fixed in a three-dimensional object or detail is free to move within che volume of the 
object or rhe detail. 

25 7. A tracking device according to claim 3 to 5, characterized in that tlie cursor (28) 

provides a shadow within the object or the detail if drawn out of these without first being 
released. 

8, A tracking device according to claim 7, characterized in tr t the shadow allows 
the cursor to be moved more easily into the object or the detail. 
30 9. A method for marking graphical details (32, 54, 36, 40. 42. 44) m connection 

with or comprised in a program as an user interface for the access of program functions 
comprised in the details, characterized in that a cursor (28) controlled by means of the 
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tracking device (10) on a display receives a sensory feedback from scams signals for a cursor 
control in a hosi unii (12, 14, 30) when rhe cursor hits or passes said graphical details (32, 
34, 36, 40, 42, 44) in such a foim ttm means (50) provided in the tracking device (10) 
gencraie a movement (46) of the tracking device (10), where a cursor (28) being fixed in a 
detail can freely move within the borders of ihe detail (32, 34, 36, 40, 42, ^14). 

10. A method according to claim 9, charactemed m that the movemenr of the 
tracking device consists of that it vibrates, bounces, bumps or slants, 

11. A method according to claim 9 to 10, characterized in that the cursor can be 
fixed within the borders of optional details (32. 34, 36, 40, 42, 44), when the cursor (28) hits 
the borders or passes them and when die cursor is released during a pressinij-down of the 
casing (20) of the tracking device. 

12. A method according to claim 9 to 11, characterized in that a giraphical detail 
can consist of an icon (34). a key (40, 42. 44), a window (32) or an edge (36) delimiting the 
frame (30). 

13. A method according to claim 9 to 12, characterized in that giaphical details m 
form of key rows are rendering different sensory feedbacks depending on the key and its 
fuiwion- 

14. A method according to claim 9 to 13, charac^erffe^ in that the cursor (28) being 
fixed in a three-dimensional object or detail is free to move within the volume of the object 
or the detail. 

15. A method according to claim 9 to 14, characterized in that xhe cursor (28) 
provides a shadow wiUiin the object or die detail if drawn out of these without first being 
released. 

16. A method according to claim 15, characterized in that the shadow allows die 
cursor to be moved more easily into the object or the detail. 
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